Search results for "multisensory integration"

Brain circuit-gene expression relationships and neuroplasticity of multisensory cortices in blind children.

2017

Sensory deprivation reorganizes neurocircuits in the human brain. The biological basis of such neuroplastic adaptations remains elusive. In this study, we applied two complementary graph theory-based functional connectivity analyses, one to evaluate whole-brain functional connectivity relationships and the second to specifically delineate distributed network connectivity profiles downstream of primary sensory cortices, to investigate neural reorganization in blind children compared with sighted controls. We also examined the relationship between connectivity changes and neuroplasticity-related gene expression profiles in the cerebral cortex. We observed that multisensory integration areas e…

Ability for Voice Recognition Is a Marker for Dyslexia in Children

2014

A recent voice recognition experiment conducted by Perrachione, Del Tufo, and Gabrieli (2011) revealed that, in normal adult readers, the accuracy at identifying human voices was better in the participants’ mother tongue than in an unfamiliar language, while this difference was absent in a group of adults with dyslexia. This pattern favored a view of dyslexia as due to “fundamentally impoverished native-language phonological representations.” To further examine this issue, we conducted two voice recognition experiments, one with children with/without dyslexia, and the other with adults with/without dyslexia. Results revealed that children/adults with dyslexia were less accurate at identify…

The EEG and fMRI signatures of neural integration: An investigation of meaningful gestures and corresponding speech

2015

Abstract One of the key features of human interpersonal communication is our ability to integrate information communicated by speech and accompanying gestures. However, it is still not fully understood how this essential combinatory process is represented in the human brain. Functional magnetic resonance imaging (fMRI) studies have unanimously attested the relevance of activation in the posterior superior temporal sulcus/middle temporal gyrus (pSTS/MTG), while electroencephalography (EEG) studies have shown oscillatory activity in specific frequency bands to be associated with multisensory integration. In the current study, we used fMRI and EEG to separately investigate the anatomical and o…

The Auditory Kuleshov Effect: Multisensory Integration in Movie Editing

2016

Almost a hundred years ago, the Russian filmmaker Lev Kuleshov conducted his now famous editing experiment in which different objects were added to a given film scene featuring a neutral face. It is said that the audience interpreted the unchanged facial expression as a function of the added object (e.g., an added soup made the face express hunger). This interaction effect has been dubbed “Kuleshov effect.” In the current study, we explored the role of sound in the evaluation of facial expressions in films. Thirty participants watched different clips of faces that were intercut with neutral scenes, featuring either happy music, sad music, or no music at all. This was crossed with the facia…

Subjective, behavioral, and physiological responses to the rubber hand illusion do not vary with age in the adult phase.

2018

[EN] The Rubber Hand Illusion (RHI) is a perceptual illusion that enables integration of artificial limbs into the body representation through combined multisensory integration. Most previous studies investigating the RHI have involved young healthy adults within a very narrow age range (typically 20-30 years old). The purpose of this paper was to determine the influence of age on the RHI. The RHI was performed on 93 healthy adults classified into three groups of age (20-35 years old, N = 41; 36-60 years old, N = 28; and 61-80 years old, N = 24), and its effects were measured with subjective (Embodiment of Rubber Hand Questionnaire), behavioral (proprioceptive drift), and physiological (cha…

Editorial: Timing the Brain: From Basic Sciences to Clinical Implications

2022

How Many Clocks, How Many Times? On the Sensory Basis and Computational Challenges of Circadian Systems

2018

A vital task for every organism is not only to decide what to do but also when to do it. For this reason, “circadian clocks” have evolved in virtually all forms of life. Conceptually, circadian clocks can be divided into two functional domains; an autonomous oscillator creates a ~24 h self-sustained rhythm and sensory machinery interprets external information to alter the phase of the autonomous oscillation. It is through this simple design that variations in external stimuli (for example, daylight) can alter our sense of time. However, the clock’s simplicity ends with its basic concept. In metazoan animals, multiple external and internal stimuli, from light to temperature and even metaboli…

Proprioception but not cardiac interoception is related to the rubber hand illusion

2020

The rubber hand illusion (RHI) is a widely used tool in the study of multisensory integration. It develops as the interaction of temporally consistent visual and tactile input, which can overwrite proprioceptive information. Theoretically, the accuracy of proprioception may influence the proneness to the RHI but this has received little research attention to date. Concerning the role of cardioceptive information, the available empirical evidence is equivocal. The current study aimed to test the impact of proprioceptive and cardioceptive input on the RHI. 60 undergraduate students (32 females) completed sensory tasks assessing proprioceptive accuracy with respect to the angle of the elbow jo…

The Role of Gamma Oscillations During Integration of Metaphoric Gestures and Abstract Speech

2018

Metaphoric (MP) co-speech gestures are commonly used during daily communication. They communicate about abstract information by referring to gestures that are clearly concrete (e.g., raising a hand for "the level of the football game is high"). To understand MP co-speech gestures, a multisensory integration at semantic level is necessary between abstract speech and concrete gestures. While semantic gesture-speech integration has been extensively investigated using functional magnetic resonance imaging, evidence from electroencephalography (EEG) is rare. In the current study, we set out an EEG experiment, investigating the processing of MP vs. iconic (IC) co-speech gestures in different cont…

Multisensory integration in hemianopia and unilateral spatial neglect: Evidence from the sound induced flash illusion.

2016

Recent neuropsychological evidence suggests that acquired brain lesions can, in some instances, abolish the ability to integrate inputs from different sensory modalities, disrupting multisensory perception. We explored the ability to perceive multisensory events, in particular the integrity of audio-visual processing in the temporal domain, in brain-damaged patients with visual field defects (VFD), or with unilateral spatial neglect (USN), by assessing their sensitivity to the 'Sound-Induced Flash Illusion' (SIFI). The study yielded two key findings. Firstly, the 'fission' illusion (namely, seeing multiple flashes when a single flash is paired with multiple sounds) is reduced in both left- …